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@ Method of and apparatus for generating auxiliary infbnmation for expediting sparse codeboolc 
search. 
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@ In many applications bivolving the coding and 
processing of speech signals the relevant ap- 
plicatrfe codet)ook is one which may be termed 
a sparse codetxx)k. That is, the majority of 
elements in the codetx>ok are zero valued. The 
searching of such a sparse codetxx)k is acceler- 
ated in accord with the present invention by 
generating auxiliary information defining the 
sparse nature of the codetxx>k and using this 
infbnmation to assist and speed up searches of 
the codeboolc 

In a particular method of searching the calcu- 
lation of the distance t>etween a target vector 
and a stored oodebook vector is enhanced by 
use of a distortion metric derived from energy 
tenns and correlation terms of the codebook 
entries. Calculatk)n of these energy and corre- 
lation tenms is speeded up by exploiting the 
sparseness of the codebook entries. TTie norv 
zero elements (NZE) of the space codebook are 
each identified and are , defined by their offs^ 
from a reference point 
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Field of the Invention 

This invention relates to codebook searching techniques and in particular to searching oodekxK)ks stored 
in memory which are used for speech processing in telephone communication systems. 

5 

Background of the Invention 

Digital transmisston is becoming important in the processing of speech for telephone oommunk:atk>n sys- 
tems including digital radtotelephone systems. Analog speech signals are converted into digital data for trans- 
10 misston and reconstnicted into analog speech at the termination end of the transmission. Digital speech 
processing has many of^tting requirements in which speech quality must be offeet against available memory, 
processing speed and bandwidth requirements. 

Because of growing demand and the conversion to digital transmisston, the requved bandwkith for a tele- 
phone transmisskHi channel has increased significantly. This has lead to the development of digital data pro- 
fs cessing techniques to reduce the bandwkith required for a particular level of subscrber capacity fbr a telephone 
transmissbn channel. 

Increasing the number of channels for a particular bandwidth has been achieved by applbation of techni- 
ques to reduce the required bit rate to accommodate a given capacity. These technk|ues include many data 
oomprssskm schemes for reducing the number of bits required to specify a particular analog signal. For 

20 example straight forward conversk>n of an analog speech signal to digital form would require a very large 
t>andwidth for transmission prot>ably making such faransmisston uneconomical. By compressing the digital data, 
the required transmissbn bandwkith can be significanUy reduced. 

Many various coding techniques have been devised to achieve the desired data compression to reduce 
the required bandwkith for trensmisston. Many of these techniques require the oonvereton of a digitally encoded 

25 signal to some preset quantized signal. Such a signal is derived by comparing an initially digitized signal with 
a limited set of preselected digitally encoded levels contained in a memory des^nated codebook. The initially 
digitized signal is compared with each codebook entry and ttie codebook entry best representing the initially 
digitized signal is selected for transmisston or for further processing prior to a subsequent transmissk>n. 
A search for a matching stored code using an element by element comparison is time consuming if the 

30 codebook is large and is hence ur^uitable for speech transmission systems that operate in real time. The use 
of small easily searched codebooks are unacceptable because it fails to provide enough informatkin to accu- 
rately reproduce ttie original analog signal. Many alternative codebook search technkfues have been developed 
to speed up the process and permit searches in the real operating time of ttie speech processing system. Many 
of these technk|ues take advantage of known properties of speech signals and known properties of digital 

35 codes. These techniques have Included the prior techniques of carefully preselecting the codebook entr»s in 
light of the expected characteristics of the speech signal to enhance the subsequent searching processes and 
various distortion measuring technk)ues for measuring expected distortions between ttie actual and coded sig- 
nal. 

40 Summary of the invention 

In many applk»tions involving the coding and processing of speech signals the relevant applicable 
codebook is one whteh may be temned a sparse codebook. That is, ttie majority of elements in ttie codebook 
are zero valued. The searching of such a sparse codebook is accelerated in accord witti the present invention 

45 by generating auxiliary information defining the sparse nature of the codebook and using ttiis information to 
assist and speed up searches of ttie codebook. 

In a particular mettiod of semhing ttie calculation of ttie distance between a target vector and a stored 
codebook vector is enhanced by use of a distortion metric derived from energy terms and correlation tenns of 
the codebook entries. Cateulation of ttiese energy and correlation terms is speeded up according to the principal 

so of ttie invention by exploiting the sparseness of ttie codebook entries. The non-zero elements (NZE) of the 
sparse codebook are each klentified and are defined by ttieir of^t from a reference point Tliese items are 
utilized to speed up the codebook search. 

In speech coding, applcations employing low bit rate CELP codecs, ttie codebooks are typicaBy sparse 
and overiapping and use a symmefaic Toeplitz spectral weighting matrix for the calculation of the distortion tenm 

55 for each codebook vector. AuxOiary information for assisting ttiese calculations can be slgnifk^anfly enhanced 
by taking advantage of ttiese added existing conditions. 
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Brief Description of the Drawing 

In the Drawing: 

FIG. 1 is a block diagram of speech transmission and reception circuitry for a transceiver unit in a mobile 
5 digital radiotelephone system; 

FIG. 2 is a schematic of a speech processing module fbr a mobile digital radiotelephone communication 
system; 

FIG. 3 IS a waveform showing how the speech encoding is applied to coded frames of speech signals; 
FIG. 4 is a flow diagram describing the encoding of speech in the speech processing module of FIG. 1 ; 
io FIG. 5 is a flow diagram describing the decoding of speech that has been encoded by the process of FIG. 
4; and 

FIGS. 6- 12 are flow diagrams describing a search of a stochastic codebook occurring in the process or 
FIG. 4. 

IS Detailed Description 

A typical radk) transmitter and receiver used in cellular radk> communicatton and having speech coding 
and decoding apparatus is shown in FIG. 1. In the transmisston portkm analog speech Is applied to the ana- 
k)g-to-digital codec 101, via input tennlnal 100. The digitized speech is encoded in the speech encoder 102 

20 and applted to the channel encoder 103. The signal is modulated in modulator 104 and applied to the radk> 
transmitter 1 05 which applies an RF signal to amplifier 1 06. The output of amplifier 1 06 is coupled to antenna 
107 for radk) transmissk>n. 

Antenna 117 receives transmitlBd radk> signals and applies them through the ampliT^r 116 to a radto 
receiver 115. This radk) signal is demodulated In the demodulator 114 and is channel decoded In the channel 

25 decoder 113. The speech signal is decoded In ttre speech decoder 1 12 and converted to an analog speech 
signal in the digital-to-anabg codec 111. The analog speech s'^nal is supplied on the output terminal 110. 

A btock diagram of a speech coding apparatus, suitable for use as a speech coder in a digital radk) tele- 
communfcatfons systems, is disclosed in FIG. 2. This speech coding apparatus is a code exdted linear predi- 
ctive (CELP) speech coder in whteh incoming analog speech signal samples are converted into a digital vector 

30 fbnn. CELP coding provkJes good speech quality at low bit rates. The digital vector of the Incoming speech 
sample » compared with a set of vectors stored in a codebook or digital memory device. The stored vector 
closest in value to the digital vector of the speech sample is selected and an index number (an address) 
associated with the stored vector is the signal transmitted. The index number Is used to select a stored vector 
in a codel)ook at a receiver from which the original speech signal is to be reconstructed. 

35 In the apparatus of RG. 2 the incoming speech signal is applied, via the input lead 201 , to a summing circuit 
202 which determines a difference between a synthesized speech signal on lead 204 and the incoming speech 
signal on lead 201 . The resulting difference signal is applied to a frequency or spectral weighting filter 207 which 
is operative in response to filter parameters applied thereto as an input to generate a weighted spectrum error 
signal whteh represents an adjusted difference between the input speech and the synthesized speech signal. 

40 The power in the spectrum error signal is measured in the energy computing device 205 whose energy 
signal output is used for searching a stochastic codebook210 so that signal energy is maintained at a minimum. 
The stochastic codebook is nonnally populated by random vectors representing representative quantized 
entries. A high proportmn of Ss stored vector elements are typk»lly zero entries (> 2/3 of the element entries) 
and hence codebook 210 is a sparse codebook. 

45 An adaptive codebook 215 contains overlapping updated vector entries representing ttie speech already 
processed and is continuously updated in each of the subframes of operation. Its output is modified by a gain 
signal applied, via multiplier 216, and tills signal wtth gain is summed in summing circuit 217 with tiie output 
of the stochastic codebook 210 which is niodified by gain applied, via multiplier 211. 

The nature of speech processing is such ttiat ttie speech is encoded by considering successive finite inter- 

50 vals of ttie speech signal. These finite intervals are designated as frames 301 , 302 and 303. Processing occurs 
wittiin a speech window, as shown by the window encompassing waveform 306 in FIG. 3. The speech signal 
within each frame, such as frame 301, is divided into subframes 311-314 'm order to facilitate the encodhg of 
ttie speech signal. The window continuously advances Introducing new entries into ttie leading subframes. 
The overall encoding process performed by ttie apparatus of FIG. 2 is shown by tiie flow chart of FIG. 4. 

55 The process is entered at ttie terminal block 401 and proceeds to ttie block 403 to p^form ttie LPC (linear pre- 
diction coding) analysis. Unear predkrtion coefficients are derived by ttiis process for ttie present window of 
interest In tenns of ttie apparatus of RG. 2 ttie coded speech is provided at ttie output of ttie Iviear predtetion 
filter 220 on leadd 204 wh»h provkJes a bit stream representative of ttie input speech applied to lead 201 . The 
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linear predictkm fater 220 provides a digital signal firm which all unnnecessary redunancy has been removed 
from the coded speech signal to reduce the required transmission bandwidth. This process is implemented by 
the instructions of blocks 403 and 405. The process of block 405 quantizes and encodes the coefficients deter- 
mined in the block 403. 

5 The subframe index counter, which indicates the active subframe. Is initially set to zero in block 407 and 
the fk}w process proceeds through dedston block 409 which is operative to respond to the last subframe count 
equaling the number of subframes in one frame. As k>ng as the count is less than the number of subframes in 
the frame the flow proceeds to the block 41 1 to compute the interpolated filter coefficients and to block 413 to 
compute the spectral weighting matrix. When the subframe count is reached, the flow of ttie process continues 

io to the block 41 5 whose instructions are operative to compute the adaptive codebook target vector from the ordi- 
nal speech input The instructk>ns of block 415 reflect the output of the frequency weighting filter 207 used to 
search the adaptive codebook 215 as shown in RG. 2. The adaptive codebook is searohed for the optimum 
adaptive codebook vector in the block 417 using spectrally weighted mean square distortton measures. 
The target vector of the stochastic codebook is computed as per the instructtons of block 419 and the 

IS stochastk: codebook is searched as per the instructtons of the block 421 to find a stored quantized vector entry 
dosely matching the actual target vector of the input speech signal. 

The adaptive codebook is updated according to the Instructtons of block 423 and the Indices of optvnum 
codebook vectors are encoded as per the instructions of the btock 425. If all the sub frames have not been 
processed the process flow proceeds via lead 428 to the Input of dedskm bk)ck 409. If all the subframes have 

20 been processed the flow continues to blocks 429 and 431 indicating the end of celp coding for the frame. 

The decoding process for recovering the original speech signal Is disdosed in the flow chart of FIG. 5. This 
process is essentially the inverse of the processed FIG. 4 and is concerned with receiving speech from the 
received digital parameters. 

The process Is entered at the tenminal 501 and the received LPC parametere are unpacked and decoded 

25 from the received bit stream as per the block 503. The subframe counter Is set to zero as per the instructk>ns 
of block 505 and the counter is read in decision block 507. As long as the count is less than three the flow pro- 
ceeds to the block 509 to compute interpolated fDter coefficients. When the count equals three the flow proceeds 
directory to bk>ck 51 1 where the optimum codebook vectors are unpacked firom the incoming bitstream. 
The execution sequence for the subframe is computed in block 513 and scaled according to the instmcttons 

30 of bk>ck 51 5. Speeh is synthesized in block 517 by passing the excitation signals through the interpolated filter. 
Error detection and recovery based on the signal energy is performed in the block 519 and the adaptive 
codebook is updated in block 521. The filtering to recover the transmitted speech signal Is peribnmed In the 
bkKk 523. Dedston block 525 determines if the last subframe has been processed and, if It has not been pro- 
cessed, the flow returns to the input of dedskm bkxk 507. If the last frame Is processed the process updates 

35 the frames in block 527 and the CELP decoding is tenminated in terminal block 529. 

The subprocess for searching the stochastic codebook, shown as block 421 in FIG. 4, is a critical portion 
of the overall coding process. Hence, it Is important that it be performed as expeditiously as possible. In many 
instances this codebook is a sparse codebook, that is one in whteh a plurality of its entries are zeros. The seardi 
process, disdosed herein. Is designed to accommodate an overlapping codebook in which adjacent vectors 

40 have many common entries, however, it is to be understood that the overlapping condition is not necessary to 
the process described. This condition is exploited according to the invention in order to speed up the search 
of the codebook. The overall process in perfonning this search Is shown in the flow charts of the FIGS. 6 through 
12. 

This process of the flow charts consklers that the stochastic codebook is a sparse fixed codebook of the 
45 size Cs having the entries { C(i)}. The codebook Indudes ttie visctora of dimenston N where: 
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Cq = [C(0),C(1)....C(N-1)]''' 

Cj = [C(N), C(N+1),... C(2N.l)]'^ (1) 



q = leCiN), C(iN+l)^, CCiN+N-l))''' 

10 

.i = [C((Nj-l)*NXC((Ng-l)*N+l),. C(Ng*N-l)]''' 

s 

IS The.value Ns represents the numtier of codelmk vectors and it is related to the codebook size Cs^by the 
expression: 

C8 = N8*N (2) 

The codeboolc is sparse and hence most of the elenients C(0 have the vaiue zero. In speech processing 
systenns such as described herein the zero elennents nnay comprise as many as 85% of the codebook entries. 
20 In searching the codebook a critical value is the L2 - norm distance measure between a target vector t and any 
codebook vector C| This measure is defined by the value: 

£1 = (t-MiQ)TW(t-mCO (3) 
The value W is a symmetric positive definite error weighting matrix; the value mi is the gain associated with 
l-th vector. The optimum value of the gain for the vector Q is defined by the expresston: 
25 _ tTWC, 

*** " CfWC, 

The above equatkm gives the actual gain values. If the values of gain are included in a quantized table 
the gain value closest to an actual gain is used. The optimum value for the gain is determined by the ratio of 
the conrelatton tenn to the energy term of the matrix. Correlation and energy tenns are well known in the art 
^ and it is not believed necessary to discuss them in detail. The value Is equal to: 

where: p, » t^ W C|, and (5) 
e, = C,TWC 

Given a value for Mi, the optimum index Is that value which minimizes the distortion measure oj. The 
^ expressions for finding oj may be expanded and the non-critical term that does not depend on the index i elimi- 
nated. The resulting expressnn of interest is the distortk>n measure where 

oi = }i^'2p^ 

The correlatton term pi can be computed by storing the spectral weighring matrix where: 

Y - |y(0). y(1).... y(N-1)IF = Wt (6) 

^ and then applying the formula: 



N-1 

Ci^Y = Pi= Z C(iN+k)*y(k) 
4s k-0 



The energy tenrn is computed by the fonrmjla: 



so N~l 

C? W Ci = ei ^ c(iN+l) W(l,k) C(iN+k) 



where W(l,k) is the (|,k)th entry of the matrix W. 

There are two sets of infprmatton defining the sparse natore of the codebook that are used to improve the 
efficiency of computation of these correlation and energy terms. The first piece of infomiation is the number of 
non-zero eienrtents (pHZE) in each vector C|. These elements are designated as N| and defined as the number 
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25 



Of non-zero elements in the i-th codetK>ok vector, Le., 

N, = #N2E {C(iN), C{iN + 1),... C{iN + N-1)}. (9) 
The second piece of information » the offsets of the non-zero elements. This information is provided for 
the i-th codetxMk vector C| only if Nf^ 0. The success ive offsets of the non-zero elements of this vector all start 
from a suitable reference point Thus C(IN+li), C(iN^,... CQH * lM)nepresents the non-zero elements of Q, 
then the successive offeets starting from C(iN) are given by the terms: 

M.(l)»lj 
Mj(2)=.l2-Ij 

(10) 

IS ^i^^^P^^Nr-JN.-l 

This information is stored for each vector C|. With the above information conceming the sparseness of the 
codebook the necessary energy and oonrelation terms may now be readily computed with a great reduction in 
20 the complexity of computations. For the correlation tenm: 

p.:=(hwhenN.=0 (11) 

Pi = if C(iN+l. )y(l.); when N. =/0 

k=l ^ . 1 

where: 

k 

Ik = £ Mi(p); where l^k^Ni 

p=l (12) 

35 For the energy term: 

ei 0; whenNj = 0 (13) 

" Ni 

Ci = X C(iN+lk) W OkJj) C(iN+lj); when N.=^ 0 
40 kj=l * (14) 



and where Ik and Ijare as defined by equation (1 2). 
45 The above procedure produces a significant reduction in the multiplyadd count at register level operation 
from 0(N) to 0(N|) in the case of the corretarion term and from 0(N^ to 0(N2,)in the case of the energy tenn. 
If greater then two-thirds of the oodebook entries are zero, a significant reduction in computation complexity is 
achieved. 

Further improvements in computation can be chained if the codebook entries are in addition overlapping 
so and if the error weighting matrix W is a Toeplrtz matrix. An overlapping codebook is one in which adjacent vec- 
tors share convnon elements. These features are likely to occur in codebooks for low bit rate CELP coders. 
The auxiiary information can be further modified to facilitate efRcient computation by exploiting ttie overlapping 
nature of the codebook ami Toeplrtz error weighting matrix W. 

In the case of an overtapping sparse codebook of size C. with the entries {C(i)}, where 0 ^ i ^ Cs-1;and 
55 where N is ttie vector dimenskwi and d is the degree of overlap; ttte codebook vectors are given by ttie exp- 
ression: 
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C^ = [C(0),CX1X..-C(N.1)]T 
= [C(d). C(d+1),... C(N4d-l)f 



(15) 



10 



IS 



Cj = [CCid). C(id+1)^.. C(N+id-l)] 



^,-l-lO((Nj^-l)d),C((Nj.l)d4^1)^. C((Nj^.l)d+N.l))'' 



Here is the number of codebook vectors and is related to the cod6txx)l( size by the relation: 

Cs = (Ns-1)*d + N (16) 
As in the general case described above the optimum index term is that tenn that nru'nimizes the di^ortion 
measure 0| which is a combination of the energy and correlation terms. The expression is: 
20 <T, = n,2e,-2MiP, (17) 

Of is the energy term C,t wq and p, is the correlation tenn C,t w t 

W = [W(lj)]NXN = IW(i.j.O]NXN (18) 

The matrix W is a Toepiitz matrix. For this special case the correlation tenm is computed by storing the 
values Y = W t and using the equation: 

25 

Pi = 2 CCid + k)y(k) 

k=0 (19) 

30 to compute for the correlation term. 

The eneigy temt is calculated exploiting the sparseness of the codeboolc and the Toepiitz nature of the 
matrix yi^ The fbllowing lecuislve relations are derived for the first codebook vector to 

N-1 

35 Ci = W(0,0) Re (0) + 2 I W(j,0)Rea) 

j=l (20) 



«> N-l-j 

Rc(i) = S C(k),C(k+j),„0^j^N-l 

k=0 (21) 

This expression is precomputed and stored. For 1 £ i we have the expressions; 

45 

«l = + ^ I2(A. , -A. ,)+(A. .-A. ,)] 
* * * k»(i-l)d '^^ . "^'^ '^^ (22) 

50 wheie: 

N-1 

A. ,= C(k+N) I Wa,0)C(k+N-j) 
55 ^'^ j=l (23) 
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N-1 

A.2=C(k) E Wa.O)C(k+j) 

j=l (24) 

Afc^ = C{k)W(0,0)C(k) (25) 
Afc^ = C{k + N)W(0,0)C(k + N) (26) 
The auxfliary information is modified by these partial sums and the oonreiation term. In the case of the first 
partial sum the number Nk.i of non-trivial multiply-adds is given by the expression; 

N^j =0; when C(k+N) = 0 and 

Nj^j =#NZE{C(k+N-l),... C(k+1)}; when C(k+N) =/0 

In the case of the second partial sum A^^ , the number of non-trivial multiply-adds is given by the exp- 
ression: 



Nj^ = 0; when C(k) = 0 and (28) 
Nj^ =#NZE{C(k+lX., C(k+N-1)); when C(k)^0 

For the case of the correlation term pi the number of non-trivial multiply-adds Nj is given by the expression: 

N, = #NZE {C(id). C{id + 1).... C(id + W-1)}; (29) 
The second set of auxDiary information consists of successive oflisets of each non-zero element of ttie 
codebook used in these sums starting from a suitable reference point Thus if 

Nj^j 0 and the elenienls 
C(k+N-lj). COc+N-ljX... C(k+N-Ij^^^) 

are non-zero, then ttie successive offsets from ttie reference point C(k*-N) are given by the ^pressions: 

'M^^l(l) = ll 



(31) 



SimUarty, if N^^^eO and ttie elements C(k+ri),C(k+r2). ...CCk + rNnJare non-zero ttienttiesuccesshre offsets 
from C(k) are given by the expressions: 

Mk^<2) = r2.rj 



(32) 
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finaDyffNi^Oand the elements C(I(H-Si), C^id+Sj),... CQd t- Sm) are non-zero then the succeed offisetsfinoin 
C(id) are given by 



M.(l) = Sj 
M.(2) = S2-Sj 



(33) 



Mi(Ni) = Sj,.-S^..l 

The prestored auxiliaiy information is used to calculate A^., using the equations: 

Afc,, = 0:ifNk,, = 0 (34) . 

Ati=C(k+N) Z W(1..0)C(k+N-l,) if N. i=/0 
»»* jssO i J (35) 

Where: 

j 

1. = r M. , (P) for l^i^N. , 

J p=i k,l^ ' . -» k.l (36) 

The value for Ai^ may t>e calculated as follows: 

= 0; if = 0 (37) 

A,,2 = C(k) £ W(r,.0).C(k+r.) if N^,=/0 

j=o ^ J "^'^ (38) 

where: 



r. = i M. ,(P),lSj^. , 

J P=l ''^ «»2 (39) 

The value of pi is calculated t>y the expression 

p, = 0; IfNi = 0 (40) 

Pi= L C(id+S.)y(S.) if N.=^0 

(41) 

where: 



S.= i M.(P); 1 SjSNi 
J P=l * (42) 

The auxiliary information developed operates to significantly reduce the computations invohrad in the 
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oodebook search. In this method the sparseness of the oodebook is exploited to the maximum extent in addition 
to exploiting the overiapping nature of the codetxx)lc and Toeplitz matrix nature of the error weighting matrix 

w. 

The process for developing and utilizing the auxDiary infonnation is disclosed in the flow processes in RGS. 
5 6- 12. The processes of FIGS. 6, 7 and 8 operate to generate the auxfliary infomnation. The process of FIGS. 
9 and 10 utflize the auxiliary infbnmation in reaching the codetmic The process of FIGS. 11 and 12 are sut>- 
processes used in the process of FIGS. 9 and 10. 

The process of FIG. 6 is operative to generate auxiiary information defining the overiapping nature of the 
sparse codetx>olL The process ^arts at the input terminal 601 in FIG. 6. The codet>ook is defined as having a 
10 size Cs and its individual envies C(l) are entered into the process. The oodetxx)k contains Ns vectors of the 
dimenston N. The envies of the vectors are specified as having an overtap to the degree d. 

With the oodebook entered in the process a counter Is initialized to the value i = - 1 in the t)lock 605. This 
counter value is incremented t)y 1 according to the expressk>n i = i ^ 1 in the next block 607. The number of 
noivzero elements ISI, in the i-th codebook vector are stored in the memory serving the process as per block 
15 609. Jts value is given by equatton (29). The envies of the i-th codebook vector take the symbdk: fbrm: 

{C(id), C(W + 1).... C{id + N-1)} 
The process of decision bk>ck 611 determines if the value of N| is zero. If the answer is no, the of^ posi- 
tions of the non-zero elements are determined in the fomn of equatton (33) and recorded and stored per the 
instructtons of block 613. The process of decision block 615 determines If the index 1 equals Ns -1 . If the answer 
20 is no, the process proceeds to block 607. Otherwise the process proceeds to bk>ck 61 7 and outputs the auxiliary 
infomnation concerning partial sums for speeding up the Gorrelatk>n computations. 

The process of FIG. 7 to determine the auxBiary information for speeding up calculation of the energy term 
and of the correlation term is begun in the start terminal 701 . The sparse codebook of size Cs is entered into 
the process by the instnictions of bk>ck 703. The counter of block 705 is initialized to the value -1 and 
25 inunediately incremented in the block 707. It is detenmined in decision block 709 if the value C^k-t-N) = 0. If the 
value is yes, the element N^^i is set equal to zero, if the value is no, the element Nk^^ is set equal to ttie number 
of non-zero elements in the sequence of length { C(k + 1),... C(k-i>N-1 )} in ttie block 71 3. These values are deter- 
mined according to the equation (27). 

The flow process proceeds to the deciston bk>ck 715 to determine if ttie element N^.^ is equal to zero. If it 
30 is, flow proceeds to decision block 719. If it is not, the flow proceeds to ttie function block 717 to store the offset 
positions as shown by equation (31 ) of the non-zero elements. 

The next dectston block 719 detemnlnes if the value C(k) is equal to zero, if it does, ttie value Nk;^ is set to 
zero in block 723. If it is not, the value of N^^ is set to ttie number of non-zero elements as indteated by ttie 
equation (28) in the block 721. 
35 The flow of ttie process proceeds to the decision block 725 to determine if ttie val ue of Nk^ is equal to zero. 
If it is not, ttie flow proceeds to block 727 wherein the oflset positions of the non-zero elements as given by 
equation (32) are stored. The flow continues to the deciston block 729 to evaluate ttie expression k = (Ns - 1)d 
- 1. If ttie expresskm Is not valkl, ttie flow returns to ttie input to block 707 and ttie process is repeated. If ttie 
expresston is valkl, the flow proceeds to the bk>ck 731 to store the developed auxiliary information to be used 
40 in the search of the sparse codebook. 

The process of FIGS. 9and 10 (connected as shown In FIG.14) is operative forusing ttie generated auxiliary 
information for searching the codebook. The flow process is entered at ttie start terminal 801 and proceeds to 
the fonction block 803 which inputs the overiapping sparse codebook of size Cs containing Ns vectors of dimerv 
sion N. The flow proceeds to ttie block 805 to input the autocorrelation of ttie first codebook vector ttiat initial izes 
45 ttie first energy term. These values are given by equation (21). Thedistrtion metricfora general codebook vector 
is determined per equation (17) Jn ttie block 807 and input to ttie process and ttie weighted target vector Y of 
dimensfon N is input In block 809. 

The process counterfor i is initialized to one in ttie block 81 1. The energy temn O] is computed in the block 
813 as per equation (20) using ttie prevkxjsly determined prestored autocorrelation term of ttie first codebook 
50 vector. The correlation term pi computed by equation (19) in ttie block 815. The value of the gain ^ which 
minimizes the distortion metric ai is selected from a predetermined table of quantized gain values in the block 
81 7. The minimum distortion m^ric a^pt Is initialized to ttie value at and ttie optimum Index value iopt is initialized 
to i in ttie block 819. 

The process counter is incremented in ttie bk>ck 821 by one. The energy tsnm is computed using equation 
55 (22) in ttie block 823 and by using ttie process detailed in ttie flow chart of RG. 1 1 . The correlation temi is com- 
puted using equation (19) in ttie block 823 and by using ttie process detaQed in ttie flow chart of FIG. 1Z 

A gain value ai, which minimizes the distortion mebic 01, is selected from the quantization table per the 
instnictions of ttie btock 827. The dedskMi block 829 detemnlnes if ttie computed distortion metric oi is ttie mini- 
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mum value. If it is, the values of Oopi and its index numt)er tpt £une set to ai and i in k>l0Gk 831 and the process 
flow proceeds to the decision trfock 833. If the distortion metric ai is not minimum, the flow proceeds directly 
to the decision t»lock 833. 

Decision block 833 detemiines if the value for the index number i is equal to the term Ns - 1 . If the equality 

5 holds the process proceeds to the block 835 to output the optimum Index term ^ and the process stops at 
tenminal block 837. If the value for 1 does not equal Ns - 1 the flow returns to the input to the block 821 where 
the counter is incremented and the process continues. 

The process for computing the energy term oi is disclosed in the RG. 11 and starts in the start terminal 
901 . The first step is to input the current vector index in the block 903. The prevtous energy term ei.i is entered 

10 in the bk>ck 905 and the codebook entries C(k) are entered in the block 907 for the values (»-1 )d ^ k ^ id-1 -t-N. 
The auxiliary information Including Nk,i Nk^ and associated offsets, developed in the flow processes of FIGS. 
6,7 and 8, are input in the block 909. The weighted matrix entries are entered in the block 915. 

The counter for the value k is initialized to the value k = (h1)d-1 in the block 915 and the energy term ei is 
initialized to the value ei.i in the block 917. The counter for k is incremented in the block 919 and the first partial 

15 sum Ak,i is computed In.the block^20 using equations (34), (35) and (36). The second partial sum is conv 
puted in ttie block 921, using equations (37) (38), and (39), the third partial sum is computed in the block 
923 using equation (25) and the fourth partial sum A^^ is computed using equation (26) in the block 925. The 
value for Oi is updated In ttie block 927 and the value of k is evaluated in the decision block 929. If ttie value 
for k is M-l the value of ei is output In the block 931 . If the value for k Is not kS-1 the flow returns to the input to 

20 the block 917 and the process » repeated. 

The process for determining the correlation temn pi is disclosed in the flow chart of ttie FIG. 12. Beginning 
at start terminal 1 001 the firrst step is the inputing of the codebook entries, inputting of the current vector index 
i and ttie C(k) in the block 1005 for id ^ k £ id + N -1. The auxiliary infonmation N| and cffsets developed ui the 
flow charts of FIGS. 6,7 and 8 are Input in ttie Nock IOO7. The we^hing matrix entries are input in ttie block 

25 1009 and the weighted target vector is input in block 1011. 

Decision block 1013 determines if the value of Ni is equal to zero. If it is the value of pi, it Is set to zero in 
ttie block 1017. If it is not ttie value of pi, it is computed using equations (40), (41) and (42) in the block 1015. 
The value of pi is output in the block 1 019. 
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Claims 



1. Speech processing circuitry for a radio transmisskm system, comprising; 
an input to accept analog speech; 
35 an analog to digital signal converter for converting ttie analog speech to digital signals; 

speech encoder circuitry for encoding the digital speech signals; Including circuitry to encode ttie 
digital speech signal as a target vector quantity; 

a sparse codebook with a plurality of codebook vectors stored ttierein; 
CHARACTERIZED BY: 

40 search means for selecting a vector from the sparse codebook that most nearly approximates the 

target vector quantity of ttie digital speech signal, comprising; 

means for generating correlation and energy terms for facOitating searching the codebook for a vec- 
tor approximating the target vector, 

means for facilitating computation of the correlation and energy terms by computing auxiliary infor- 
45 mation, defining a sparse nature of the sparse codebook, including; 

means for detenmining the number of noa-zero elements in each codebook vector; 

means for determining ttie successive offsets of the non-zero elements of the codebook vector; 

means for computing the conelation term and the energy tenn from the auxiliary information; and 

radio transmission circuitry for transmitting the encoded digital speech signal; 



Speech processing drouitry for a radfo transmisskui system as claimed in daim 1 , 
furttier CHARACTERIZED BY 

means for detemiining a degree of overiapping of vectors in the codebook; 

means for utilizing the degree of overiapping for computatk>n of ttie energy and correlation terms. 

Speech processing ctrcuitry for a radk) transmissk)n system as claimed in daim 2, 
furttier CHARACTERIZED BY: 

means for determining a gain value for each Individual vector, and 
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means for determining the optimum gain value. 

4. Speech processing circuitry lior a radio transmtesion system as claimed in daim 3, 

further CHARACTERIZED BY: 
5 means for detenmining a distortion metric, and 

means for using the distortion metric for selecting a gain value. 

5. A method for processing speech in a radio telecommunication system, comprising: 

encoding a digital speech signal lyy the steps ot 
10 converting tiie digital speech signal into a target vector quantity; 

storing a plurality of random oodebook vectors into a stored codet>ook having a sparse content of 
entities such that at least a majority of the elemententiries have a zero value; 

searching the codelxwk to select a random codet>ook vector ttiat most dosely matches ttie target 
vector; 

15 CHARACTERIZED BY the steps of searching comprising: . ... > 

determining and storing the number of non-zero elements in each codetxx)k vector; 

determining and storing the successive offsets of the non-zero elements for each oodel)ook vector 
as a starting refersnoe point; 

associating an index number witti each random oodet)ook vector; 
20 defining an error weighring matrix; 

computing a correlation term t)etween the codetxx)k vectors and ttie target vector by summing the 
products of the non-zero elements of the codebook vectors and the oonesponding elements of the target 
vectors using stored successive offsets; 

computing an energy term for the codebook vectors by summing only determined non-zero eie- 

25 . ments; 

detemiining gain values assodated witii each random codebook vector as a ratio of the correlation 
term to the energy term; 

determining a distence value between tiie target vector and ttie random vectors of ttie oodebook 
as a dlfforence between ttie gain modified correlation tenms and gain modiTied energy terms of tiie 
30 codebook vectors; 

detenmining the optimum index number associated with a distance value to minimize the distance 
value between the codebook vector and the target vector, and 
transmitting the index number by radto signals. 

35 & A nnettiod for processing speech in a radto telecommunteation system, as daimed in dabn 5; 
furttier CHARACTERIZED BY: 

detenmining a degree of overtapptng of codel>ook vectors; 

Deriving and storing recursive relations from ttie overiapping of codebook vector entities, and 
detemiining the energy terms by further utilizing partial sums of ttie recursive relations. 

40 

7. A method for processing speech in a radto telecommunication system, as daimed in daim 6; 
further CHARACTERIZED BY 

d^ermining ttie correlatton terms by forther utilizing partial sums of ttie recursive relations. 

45 a. A method fior processing speech in a radk> telecommunication system, as daimed in daim 7; 
r. furthcr CHARACTERIZED BY: 

detenmining ttie partial sums of ttie recursive relations by multiplying each of ttie codebook entries 
by ttie corresponding error weighting matrix entry. 

50 9. A method for processing speech in a radb telecommunication system, as claimed in daim 7; 
wherein the step of determining the gain value is further 
CHARACTERIZED BY: 

comparing a gain value, determined as a ratk) of ttie correlation tenm to ttie energy term, witti a 
stored plurality of gain values and selecting ttie stored gain value dosest to ttie value of ttie ratio. 

55 
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FIG. 4 
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FIG. 6 
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FIG, 6 
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FIG, 7 
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FIG. 8 
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FIG. 10 
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FIG. 12 
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